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Abstract 

While virtual technology for training in the simulation field has a long history in medicine, aviation, and the 
military, the application of similar emerging and innovative technologies in teacher preparation and education has 
been limited. TLE TeachLive™ (Teaching Learning Environment, Teaching in a Virtual Environment) [TLE] is an 
inventive mixed-reality environment (the blending of real and synthetic content) where prospective teachers can 
interact with a group of virtual students. The purpose of the virtual teaching environment of TLE is to strengthen 
teacher recruitment, preparation, and retention in education by allowing teachers to improve their skills with 
virtual students, providing a more constructive and ethical approach to learning the art of teaching. The protected 
environment allows pre-service teachers to utilize their emergent knowledge of behavior, diversity, and effective 
instruction in a flexible and safe practice environment. In this simulated environment, permission does not have to 
be gained to work with actual children and they are not exposed to missteps on the part of novice teachers as the 
teachers learn to refine their instructional techniques. This study investigated pre-service teachers’ use of 
differential reinforcement of incompatible behavior, a set of behavior management strategies, in a simulated 
classroom. Results indicated that the majority of participants evidenced an increase in the use of these strategies to 
enhance student engagement in the classroom. 

Keywords: technology, teacher preparation, classroom simulation, classroom management, behavior management 

1. Introduction 

In the second half of the twentieth century, the world was marked by a global diversification of the 
communications media and with it came a burgeoning visual culture that radically altered the dissemination and 
production of information and knowledge. In the realm of education, however, use of visual media was 
perceived by some as a threat to literacy while others touted it as a potentially powerful tool for educators 
(Goldfarb, 2002). In learning environments throughout education, the visual elements of instruction (e.g., 
graphic organizers, videos, charts, tables, and presentations) play an important role in learning. Well-conceived 
and rendered visuals help any audience understand and retain information (Wileman, 1993). According to Clark 
and Mathews (2000), the use of visual technology enhances learning by providing a better understanding of the 
topic, as well as engaging and motivating students. The development of visual technologies to train and educate 
has grown increasingly sophisticated and now includes virtual learning environments, often known as simulators. 
Simulators and simulated environments combine visual and kinesthetic engagement for learners and are 
considered powerful teaching tools in technical fields like medicine, engineering, and aviation. Simulation 
technologies are powerful educational tools that are becoming more widely used in many technical professions 
due to their effectiveness in providing powerful, multidimensional learning experiences (Siemens & Tittenberger, 
2009). At present, simulation technologies are most often used in two situations; a) low-frequency events that 
require high acuity, such as emergency landing procedures, and b) training for procedures that are irreversible, 
such as surgery and patient care (Damassa & Sitko, 2010). Simulation of teaching and learning experiences, 
though inconsistently and scarcely utilized currently, may grow as they begin to be used more frequently for 
evaluating student performance, as well as for increasing communication skills, critical thinking and application 
of knowledge. Environments that rely on computers and computer interface devices such as static or dynamic 
representations of phenomena and training modules have been the easiest to adapt to provide a meaningful 
assessment environment. Examples include laparoscopic surgical procedures and military war fighting readiness. 
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However, the creation of effective simulators based on human variables for use in teaching has been considered 
more difficult to achieve and, therefore, their availability has lagged behind other visual teaching technologies. 

How might the use of visual-based simulated environments support teacher preparation? The need to recruit, 
prepare, and retool the teaching force in today’s schools is well documented in the literature (Clark & Matthews, 
2000; Dieker, Hynes, Hughes, & Smith, 2008; Hughes, Stapleton, Hughes, & Smith, 2005), especially in critical 
teaching shortage areas such as mathematics, science, and special education. Although teacher preparation 
programs and alternative certification programs that address critical teaching shortage areas are available, most of 
these programs rely on traditional methods of preparing teachers to work in today’s classrooms: college courses, 
field experiences, and some version of culminating internship or student teaching. Placement of pre-service 
teachers in school environments has become increasingly difficult as school divisions struggle with accountability, 
liability, and privacy issues, resulting in a decreasingly small number of contact hours in preparation for assuming 
full classroom duties for many teachers. Despite the collaborative efforts of colleges of education and school 
districts to make these experiences comprehensive, many beginning teachers have reported that they feel 
inadequately prepared (Darling-Hammond, 2003; Ingersoll, 2001). 

1.1 Visual-Based Simulated Technology’ for Teacher Preparation 

While visual-based technology for training in the simulation field has had a long history in medicine, engineering, 
and aviation, the application of emerging and innovative simulation technologies in teacher preparation and 
education has been limited (Hughes, Stapleton, Hughes, & Smith, 2005). Traditional internship experiences in 
teacher education are rooted in the practice of having prospective teachers interact with students as during 
practicum assignments and as student teachers, thus using real students to help novice teachers improve their 
teaching skills. By contrast, in a visual-based simulated teaching environment, novice teachers can practice 
teaching and/or classroom management techniques, shaping their skills in a controlled environment. Additionally, 
novice teachers can utilize the technology as often necessary to correct and repeat their efforts. 

TLE TeachLive™ is an innovative mixed-reality environment (the blending of real and synthetic content) where 
prospective teachers can interact with a group of virtual students (Dieker et al., 2008; Hughes et ah, 2005). The 
purpose of the visual-based simulated teaching environment of TLE is to enhance teacher recruitment, 
preparation, and retention in education by allowing teachers to improve their skills with virtual students, 
providing a more clinical and enhanced approach to learning the art of teaching. This novel approach of a 
mixed-reality-based classroom experience addresses the need to improve teachers’ effectiveness in managing 
adolescent behaviors in a way that provides for an unlimited variety of situations, while eliminating risks to both 
real students and novice teachers. 

In the TLE mixed-reality environment, novice teachers enter a virtual setting designed to replicate a 
middle-school (grades 6-8) classroom to work with classroom students who are virtual avatars. The personality 
attributes of these five adolescents are based on the adolescent development research of William A. Long (1985; 
1989) and Rudolf Dreikurs (1958; 1968). According to Long’s (1989) framework on adolescence development, 
there are four generic personalities - aggressive-independent; aggressive-dependent; passive-independent; and 
passive-dependent -supplemented with zero to four ancillary traits (phobic, hysteric, obsessive/compulsive, and 
impulsive) in different levels of intensity. Thus, the five avatars have attributes of one of these personalities. As a 
result, a classroom can be populated by a group of virtual students that respond in a variety of ways that typify 
the attributes and behaviors unique to the middle school-age student population. Using the attributes of 
adolescents together with the research on facial expressions, body language, motion capture, and artificial 
intelligence, the developers of TLE were able to create immersive virtual reality environments that can be used 
to support the development of beginning teachers. 

1.2 Classroom Behavior Management Strategies 

One indicator of effective teaching in middle and high school is the quality of the teachers’ classroom management 
skills (Weiner, 2003; Wolk, 2003). As such, classroom management coursework is required for teacher licensure in 
most states and provided in most university teacher preparation programs. However, a 2006 national teacher 
survey of 1,001 K-12 teachers across the United States, one in five first-year teachers did not feel adequately 
prepared to maintain order and discipline in the classroom (Markow, Moessner, & Horowitz, 2006). Difficulty 
managing student behavior is frequently cited as a source of frustration for teachers and a common reason why 
new teachers leave the profession (Ingersoll 2001), leading experts to assert that pre-service teachers should be 
trained more rigorously on effective, evidence-based classroom management practices (Simonsen, Fairbanks, 
Briesch, Myers, & Sugai, 2008). 

Better preparation to manage student behaviors in general education teacher preparation programs may lie in 
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adopting practices typically used by special education teachers who serve groups of students with disabilities. 
While special education teacher preparation programs ensure instruction and practice in managing individual 
student behaviors, such individualized and intensive instruction is infrequent in general education teacher 
preparation programs (Oliver & Reschly, 2010). Given the rate of inclusion of all students with disabilities and the 
pressures of accountability measures, it would follow that general educators may benefit from instruction in 
individual behavior management strategies like differential reinforcement of incompatible behavior (DRI). 

DRI is a simple and effective behavior management strategy for decreasing undesirable classroom behaviors 
while reinforcing desirable behaviors through verbal prompting, precise praise, and planned ignoring. To address 
an undesirable target behavior, the teacher consistently reinforces a desirable behavior that is incompatible with 
the target behavior (Wheatley et ah, 2009). Teachers who use it must understand the basic principles of positive 
reinforcement and behavior (Auld, Belfore, & Scheder, 2010; Shumate & Wills, 2010). As such, it may be an 
ideal and portable strategy for use in a general education classroom to increase on task classroom behaviors like 
providing the prompted, elaborative, on topic responses that increase student engagement and learning. 

Hence, this study leveraged computer simulation technologies, introducing pre-service teachers to a behavior 
management strategy designed to increase student engagement (DRI) and provide practice opportunities in a 
controlled setting. Specific research questions addressed in this study were as follows: 

1. Does the instruction of pre-service teachers in DRI affect overall verbal responses by virtual students in a 
simulated instructional setting? 

2. What is the effect of the instruction of DRI on pre-service teachers’ classroom management practices in a 
simulated instructional setting? 

3. What were the pre-service teachers’ perceptions of DRI, including feedback and the simulated instructional 
setting? 

2. Method 

2.1 Participants 

The research method employed a multi-element brief experimental analysis with six pre-service teacher 
participants and four virtual students in a simulated classroom environment (TLE). Though there are five virtual 
students in the simulated environment, one student, as per his assigned personality, did not exhibit either disruptive 
or unengaged behavior. Data was not taken on this student. Of the four avatars, two were female 
(aggressive-dependent and passive-independent) and two were male (passive-dependent and 
aggressive-dependent) representing the four generic personalities. The pre-service teacher participants were 
general secondary educators in a residency teaching immersion program. The six pre-service teacher participants 
included three women and three men who were 22 to 30 years old (M = 25 years). They were taught several 
differential reinforcement of incompatible behavior (DRI) strategies aimed at increasing student engagement 
through on task behavior and decreasing undesirable behaviors that can interfere with student learning. 

2.2 Mixed Reality Environment 

In the mixed reality environment, a covert off-site interactor controls the actions of all five virtual students. The 
interactor, a person trained in acting and improvisation, puppeteers the character of the adolescent virtual 
students being taught by the pre-service teacher. Each time a pre-service teacher speaks to a virtual student, the 
interactor takes the role of the virtual student and makes both nonverbal and verbal expressions that correspond 
to the attributes of the virtual student. Thus, the virtual student exhibits a unique and appropriate personality and 
can respond to the pre-service teacher’s tone of voice, appearance, and instructional efforts in a generative way. 
One interactor can control the actions of all five virtual students so that the small classroom represents the wide 
variety of behaviors seen in a typical classroom. The interactor is located in a university simulation lab and her 
voice and actions are projected through Skype, free software that allows video calling through an Internet 
connection. While the interactor can see the pre-service teachers, she remains unknown to the pre-service 
teachers, who see only the classroom and virtual students on a projection screen. 

As the pre-service teacher interacts with the five virtual students, the interactor can increase or decrease the level 
of physical and verbal misbehavior or compliance displayed by the virtual students. These misbehaviors can 
consist of virtual students presenting more disruptive or more withdrawn behaviors (depending on the 
character’s attributes). For that reason, a unique teaching experience can be created for each pre-service teacher. 
If a pre-service teacher makes an error, he or she can reenter the virtual classroom and try again to teach the 
same students the same concept or skill and use behavior strategies. Teaching sessions typically last five to ten 
minutes, but because of the interactor’s ability to rapidly present a series of challenging behaviors through the 
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five virtual students, pre-service teachers typically view the sessions as intensive and demanding. 

2.3 Design 

Identifying an effective behavior management strategy can be an important skill for pre-service teachers in the 
delivery of high quality, effective instruction to all students (Wright-Gallo, Higbee, Reagon, & Davey, 2006). 
Although variations of brief experimental analysis have been used to investigate intervention effects of behavior 
management strategies with various student populations (Eckert, Dunn, Rosenblatt, & Truckenmiller, 2008), 
there is a paucity of research in its application in the context of teacher education programs. Therefore, brief 
experimental analysis was used to investigate the effects of behavior management training on the instructional 
practice of pre-service general educators as evidenced by the verbal behaviors of virtual students in a simulated 
classroom environment. 

The brief experimental analysis design allows for a rapid, systematic testing of treatment effects to determine the 
most efficacious intervention components, and to prevent extended implementation of an ineffective intervention 
(Kennedy, 2004, 2005; Martens & Gertz, 2008; McComas & Burns, 2009). This multi-element design provided a 
direct comparison of three different teacher training conditions in the implementation of the DRI strategy. This 
single subject design used each participant as his or her own control (Center & Leach, 1984). The dependent 
variables in the study included the frequency measures of three types of virtual student verbal responses to 
teacher instruction: a) prompted—the virtual student verbalizes a response to the teacher’s statement or question), 
b) elaborative—the virtual student verbalizes two or more word responses relevant to the lesson topic, and c) On 
topic—the virtual student verbalizes responses that are positively engaged on the lesson topic. For each 
participant, it was necessary to establish a baseline on the dependent variables. 

This design also required repeated measures of the dependent variables for each participant. The three research 
study phases include baseline, intervention, and follow-up. The two-week baseline study phase exposed the four 
virtual students to their usual instruction 10-minute simulator sessions with each pre-service teacher with no 
other intervention provided. The nine-week intervention phase exposed the four virtual students to pre-service 
teacher instruction that incorporated the DRI strategy intervention over the course of three 10-minute simulator 
sessions with each pre-service teacher. There were three different intervention conditions to which the six 
pre-service teachers were initially randomly assigned: a) Group 1 (N= 2): video training only , b) Group 2 (N = 
2): video training, followed by email feedback, then peer focus group feedback, and c) Group 3 (N= 2): video 
training, followed by peer focus group feedback, then email feedback. The study follow-up phase over one 
2-hour group meeting session with all of the pre-service teachers provided researchers with valuable feedback 
about the social validity of the DRI intervention and the perceived realism of the simulated environment. 

2.3.1 Intervention 

As part of their teacher preparation program, the pre-service teacher participants had been previously instructed 
in basic behaviorist principles like positive reinforcement. The independent variable in this study was training on 
the differential reinforcement of incompatible behavior (DRI) strategies and consisted of three intervention 
conditions noted above: a) video training only, b) video training, followed by email feedback, then peer focus 
group feedback, and c) video training, followed by peer focus group feedback, then email feedback. The initial 
DRI intervention was delivered by a research assistant, using a video training program to which all pre-service 
teachers were concurrently exposed. [The scripted training program is available from the first author of this 
manuscript.] In the video, an expert on DRI described the principles of DRI with the emphasis on the necessity 
of incorporating the DRI principles of antecedent verbal prompting (AVP), elaborative verbal prompting (EVP), 
precise praise (PP), and planned ignoring (PI). The video included numerous examples of how to implement 
each principle of DRI and was followed by a role-play scenario that demonstrated the strategies, along with 
feedback to the “teacher” on the effectiveness of her use of the strategies. Immediately following the initial video 
training, the research assistant administered a written assessment to each pre-service teacher, ensuring that 
mastery criterion of the DRI intervention content was gained by all. Following their assessment, all pre-service 
teachers were sent an email message containing their weekly simulator teaching schedule coordinated with their 
random intervention condition assignment. The pre-service teachers also were provided the email address of the 
DRI expert for follow-up questions. 

2.4 Interrater Reliability 

Interrater reliability was calculated on 25% of the videotaped sessions for each pre-service teacher (Kennedy, 
2005). Interrater agreement was determined by dividing the number of agreements by disagreements and 
multiplying by 100. The mean interrater reliability for Participant G was 97% (range= 90-100%), Participant I 
was 98% (range= 93-100%), Participant C was 97% (range= 86-100%), Participant D was 96% (range 92-100%), 
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Participant A 97% (range 90-100%), and Participant F was 98% (range 93-100%) for all conditions and target 
behaviors. 

3. Results 

The effects of the instruction of pre-service teachers in DRI on overall verbal responses by virtual students and 
on the pre-service teachers’ classroom management practices in a simulated instructional setting were analyzed 
by graphing the frequency of target behaviors. Formative data analysis included visual analysis of graphed 
baseline and intervention phase data. Results are summarized by research question, organized by pre-service 
teacher data, and virtual student data. 

3.1 Research Question 1: Does the instruction of pre-service teachers in DRI affect overall verbal responses by 
virtual students in a simulated instructional setting? 

Data pertaining to the frequency of appropriate verbal responding (e.g. on-topic, elaborative, and prompted 
responding) exhibited by the four virtual students for participants were collected during baseline and intervention 
sessions. 


Table 1. Mean Occurrence of Positive Verbal by Virtual Students 





Baseline 



Session Means 

Grand 

Means 



On-Topic 

Elaborative 

Prompted 

On-Topic 

Elaborative 

Prompted 


Group 

Teacher 

3.75 

7.75 

4.25 

4.75 

7.67 

5.83 

.75 

1 

G 




(+1) 

(-.08) 

(+1.33) 



Teacher 

3.67 

7.25 

4.25 

3.75 

8.42 

4.08 

.36 


I 




(+.08) 

(+U7) 

(-.17) 


Group 

Teacher 

7.00 

6.25 

6.5 

5.00 

6.83 

7.58 

-.11 

2 

C 




(-2.0) 

(+.58) 

(+1.08) 



Teacher 

10.8 

8.00 

8.25 

2.84 

10.8 

5.50 

-2.64 


D 




(-7.96) 

(+2.8) 

(-2.75) 


Group 

Teacher 

8.25 

6.75 

8.75 

6.67 

7.83 

8.58 

-.22 

3 

A 




(-1.58) 

(+1.08) 

(-.17) 



Teacher 

3.00 

9.00 

6.00 

4.17 

7.25 

8.25 

.56 


F 




(+1.17) 

(-1.75) 

(+2.25) 



Description: Table 1 shows the mean occurrences of positive verbal responding by virtual students during 


baseline and the three intervention sessions. 


3.1.1 Group 1 

Group 1 was comprised of pre-service teachers G and I. This group received only video instruction in the DRI 
strategy prior to intervention session 1 in the virtual environment; however, they did not receive any feedback 
following intervention sessions 2 and 3 in the virtual environment. During intervention sessions for Participant G, 
virtual student data indicated an increase in the mean occurrence of on-topic (M=4.75) and prompted (M=5.83) 
responses. Additionally, a minimal decrease in the mean number of elaborative responses (M=7.67) was 
demonstrated during intervention for Participant G. During Participant I’s intervention sessions, virtual students 
demonstrated a slight increase in elaborative responses (M=8.42), a minimal increase in on-topic responses 
(M=3.75), and a slight decrease in the occurrence of prompted responses (MM.08). 

3.1.2 Group 2 

Pre-service teachers C and D were the participants in Group 2. This group received video instruction in the DRI 
strategy prior to intervention session 1. Additionally, these teachers received feedback via email following 
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intervention session 1 and feedback via peer focus group following intervention 2. On the whole, virtual student 
data for Participant C indicated an increase in the mean occurrence of prompted responses (M=5.83) and a 
decrease in the mean occurrence of on-topic (M=5.00) and elaborative (M=6.83) responses during intervention 
sessions. During Participant I intervention sessions, virtual students demonstrated a moderate increase in 
elaborative responses (M=10.8); however, moderate decreases in the mean occurrence of on-topic responses 
(M=2.84), and prompted responses (M=5.50) were noted. 

3.1.3 Group 3 

Group 3 was comprised of pre-service teachers A and F. This group received video instruction in the DRI 
strategy prior to intervention session 1, as well as feedback via peer focus group following intervention session 1 
and feedback via email following intervention 2. Overall, virtual student data for Participant A indicated an 
increase in the mean occurrence of elaborative responses (M=7.83), a moderate decrease in the mean occurrence 
of on-topic responses (VT—6.67), and a minimal decrease in the mean occurrence of elaborative responses 
(M=8.58) during intervention sessions. During Participant F intervention sessions, virtual students showed a 
moderate increase in on-topic (VT—4.17) and prompted (M=8.25) responses. Additionally, a moderate decrease in 
the mean occurrence of elaborative responses (M=7.25) was observed. 

3.2 Research Question 2: What is the Effect of the Instruction of DRI on Pre-service Teachers ’ Classroom 
Management Practices in a Simulated Instructional Setting? 

Data related to the frequency of DRI strategy application (e.g., antecedent verbal prompts (AVP), elaborative 
verbal prompts (EVP), precise praise (PP), and planned ignoring (PI) exhibited by each pre-service teacher in a 
simulated instructional setting were collected during baseline and 3 intervention sessions. 


Table 2. Mean Occurrence of Differential Reinforcement of Incompatible Behaviors Strategies by Pre-service 
Teachers 





Baseline 



Session Means 


Grand 

Means 



AVP 

EVP 

PP 

PI 

AVP 

EVP 

PP 

PI 


Group 1 

Teacher 

G 

16 

1 

3 

15 

18 

(+2) 

9.67 

(+8.67) 

12.33 

(+9.33) 

6.33 

(-8.67) 

(2.83) 


Teacher 

I 

18 

4 

8 

14 

21.67 

(+3.67) 

4.00 

+/-0 

4.00 

(-4) 

12.00 

(-2) 

(-.58) 

Group 2 

Teacher 

C 

22 

7 

10 

7 

33.00 

(+11) 

9.67 

(+2.67) 

11.00 

(+1) 

8.00 

(+1) 

(+3.92) 


Teacher 

D 

38 

3 

2 

5 

30.00 

(-8) 

6.33 

(+3.33) 

4.00 

(+2) 

15.33 

(+10.33) 

(+1.92) 

Group 3 

Teacher 

A 

16 

5 

0 

0 

40.33 

(+24.33) 

3.33 

(-E67) 

6.00 

(+6) 

12.67 

(+12.67) 

(+10.33) 


Teacher 

F 

23 

4 

9 

8 

29.33 

(+6.33) 

3.67 

(-.33) 

11.67 

(+2.67) 

13.33 

(+5.33) 

(+3.50) 


Description: Table 2 shows the mean occurrences of DRI strategies by each pre-service teacher during baseline 
and intervention sessions. 


3.2.1 Group 1 

Participant G demonstrated an increased use of AVP (M=18.0), EVP (M=9.67), and PP (M=12.33) during 
intervention. A decrease in the use of PI (M=6.33) was noted. Participant I exhibited an increased use of AVP 
(M=21.7) and PP (4.00) during intervention. Use of EVP (M=4.00) demonstrated no change while a decrease in 
the use of PI (12.00) was noted. 
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3.2.2 Group 2 

Participant C showed an increased use of all four DRI strategies during intervention with means of 33.0, 9.67, 
11.0, and 8.00 respectively for AVP, EVP, PP, and PI. During intervention. Participant D displayed an increased 
use of EVP (M=6.33), PP (4.00), and PI (15.3) while presenting a decreased use of AVP (M=30.0). 

3.2.3 Group 3 

Participant A demonstrated an increased use of AVP (M=40.3), PP (M=6.00), and PI (M=12.7) during 
intervention. A decrease in the use of EVP (M=3.33) was noted. During intervention. Participant F exhibited an 
increase in the use of AVP (M=29.3), PP (M=11.67), and PI (13.3). Participant F exhibited a decrease use of EVP 
(M=3.67) during intervention. 

3.3 Research Question 3: What Were the Pre-service Teachers ’Perceptions of DRI, Feedback, and the Simulated 
Instructional Setting? 

While intervention data were taken on six teachers in the three intervention groups, nine received the video 
intervention and were asked their perceptions of the DRI intervention and the TLE simulator. Those participants 
in Groups 2 and 3 were asked about their experience with the two feedback modalities. 


Table 3. Pre-Service Teachers’ Perceptions of DRI, Feedback and the Simulated Instructional Setting 



N 

1 

2 

3 

4 

5 

Means 



Strongly 




Strongly 




disagree 




Agree 


I feel the use of differential 

9 

1 

0 

4 

4 

0 

3.22 

reinforcement of incompatible 
behaviors will aid my performance 
as a teacher. 


(11%) 


(44%) 

(44%) 



I feel that the DRI instructional 

9 

1 

5 

2 

1 

0 

2.33 

video provided enough 
information on how to use the DRI 


(11%) 

(55%) 

(22%) 

(11%) 



strategies. 

I feel the email feedback helped 

6 

2 

1 

3 

0 

0 

2.16 

me implement the differential 
reinforcement of incompatible 
behaviors intervention. 


(33%) 

(17%) 

(50%) 




I feel the peer focus group 

7 

1 

2 

2 

2 

0 

2.71 

feedback helped me implement the 
differential reinforcement of 
incompatible behaviors 
intervention. 


(14%) 

(29%) 

(29%) 

(29%) 



The feedback that I received 

7 

2 

1 

4 

0 

0 

2.29 

(e-mail and/or focus group) 
increased my understanding of my 
teaching as it relates to differential 
reinforcement of incompatible 
behaviors 


(29%) 

(14%) 

(57%) 




Participating in TeachLive™ 

9 

3 

2 

3 

1 

0 

2.22 

helped me become a better 
classroom teacher. 


(33%) 

(22%) 

(33%) 

(11%) 



I feel comfortable using 

9 

0 

2 

6 

1 

0 

2.89 

differential reinforcement of 
incompatible behaviors in my 
classroom. 



(22%) 

(67%) 

(11%) 




Description: Results of Group 2 and Group 3 pre-service teachers’ perceptions of the DRI strategy, as well as the 
two feedback modalities, and the simulated instructional setting. 
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Using a 5-point Likert scale ranging from 1 ( strongly disagree) to 5 ( strongly agree), all participants provided 
neutral to positive responses about their comfort using DRI techniques in their classrooms (M=2.89) and the use 
of DRI to aid their performance as teachers (VU3.22). Participants apparently felt less positive about the 
comprehensiveness of the DRI instructional video (M=2.33) and the effect of participating in TLE on their 
performance in the classroom (VU2.22). For those participants who received feedback (Groups 2 and 3), the 
usefulness of the feedback was rated at means of 2.33 for email feedback and 2.71 for peer focus group feedback. 
Regarding the effect of feedback in general, participants responded at neutral or negative levels (M=2.43) to the 
statement that the feedback increased their understanding of teaching at it related to DRI techniques (see Table 

3). 

The pre-service teachers were also asked to respond to three open-ended questions. Pre-service teachers’ 
responses to the first question: How do you feel TeachLive™ has influenced your performance as a teacher? 
indicated awareness of the differences between TeachLive™ and actual classroom experiences. One participant 
stated, “...not sure TeachLive™ was considerably beneficial compared to the real world experience I had.” 
Another participant commented, “I don’t think it has [influenced his/her performance as a teacher]—maybe if I 
had never stepped into a classroom.” At the same time, others responded that the simulator “made me more 
aware of the options that I have when dealing with student disruptions,” and “shows me if I am doing a strategy 
correctly because negative student behaviors would diminish.” 

When asked the second question: What aspect of this study do you feel benefited you the most?, participants 
commented most often about learning a new strategy. One noted that the focus group feedback improved his/her 
performance in the simulator. Others commented that there were no benefits. Finally, responses to the third 
question: What aspect of this study do you feel benefited you the least? indicated frustration at the limitations of 
the virtual students. Participants commented that the virtual students’ responses were “...too predictable and 
unchangeable” and as such were “ineffective.” Another stated that use of the virtual students and not real 
students was a limitation, specifically, “Avatars are programmed to act a certain way so behaviors that deviate 
from the norm were not observed.” Other participants expressed dissatisfaction with the intervention video and 
timely arrival of feedback. 

4. Discussion 

Simulated teaching environments have the potential to create more and better experiential practica for 
pre-service teachers. In such settings, pre-service teachers may be able to practice teaching techniques like DRI 
without negative effects on students (Dieker et al., 2008; Hughes et al., 2005). The responsive reactions and 
performance of the virtual students provide important information about pre-service teachers’ efforts that cannot 
be gained in teacher preparation classes. Because first year teachers often cite behavior disruptions as a primary 
source of frustration and job dissatisfaction (Ingersoll, 2001) during this study, pre-service teachers were both 
taught a behavior management technique and given feedback on his/her ability to implement the technique in a 
virtual classroom. In terms of virtual student responses to the DRI strategy, the greatest overall gains in positive 
responses elicited from the virtual students (+.56) (on-topic, elaborative, and prompted responses from the 
virtual students) were made by Group 1, the group that was given the intervention but did not receive feedback. 
Groups 3 and 2 achieved minimal (+.17) or no (-1.38) overall gains in positive student responses (see Table 1). 
These results support the notion that DRI is an effective behavior management strategy for decreasing 
undesirable classroom behaviors, while reinforcing desirable behaviors (Wheatley et al., 2009). As such, despite 
participants’ concerns about the DRI instructional video, participants in Group 1 may have striven to a greater 
degree to use the DRI techniques, resulting in changes in virtual student performance: however, the delivery of 
feedback appeared to have little impact on participant performance for Groups 2 and 3. 

Regarding pre-service teachers’ implementation of the DRI strategy as measured by their use of the four 
components of the DRI strategy (AVP, EVP, PP, and PI), all participants evidenced an increase in the use of these 
strategies. Grand means for Group 1 showed the fewest occurrences of these behaviors (+1.14) while Groups 2 
(+2.92) and 3 (+6.92) demonstrated greater increases. As such, despite comments regarding feedback, the groups 
receiving feedback demonstrated the greatest gains in the use of the DRI strategy. 

In terms of the pre-service teachers’ perceptions of the simulator and the DRI strategy, while some participants 
found it a useful setting in which to hone their teaching skills, others felt hampered by the limitations of the 
virtual students and the environment itself. As such, more research on the overall effectiveness of simulation 
settings in education should be explored. Despite noting the potential limitations of the simulated classroom 
environment for practicing behavior management techniques, participants indicated that learning the DRI 
strategy was a positive aspect of participation in the study. 
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The generalizability of the results is limited by several factors. At six, the sample size of participating teachers is 
too small to document a strong relationship between the independent and dependent variables. However, the 
sample is relatively diverse and the breadth of data collected may guide additional research. Additionally, the use 
of a virtual classroom of student avatars lent an inherent limitation to the study. The number of supportive and 
confounding variables increases exponentially when actual students are added in the numbers that typically are 
assigned to middle school classrooms. The duration of the study may also have limited the teachers’ opportunity 
to apply and refine the DRI strategy and may also have limited the researchers’ ability to capture data trends. 

Future research in this area should include maintenance and generalization probes to determine whether 
pre-service teachers continue to use intervention strategies that have been learned in the simulator. The interactor 
who controls the simulator should be supplied with a greater variety of responses to pre-service teachers’ efforts 
in order to provide a more realistic environment. In addition, pre-service teachers who use simulators should 
routinely view the resulting video with their clinical faculty for instructive purposes. 

Teaching is an unpredictable and highly variable endeavor. Current technology cannot effectively simulate the 
spectrum of possible classroom situations. However, the same is true of medical, flight and counseling 
simulators. As such, it is highly unusual for any professional to begin practice after preparation in simulated 
environments alone. However, teaching simulators do provide a responsive practice environment that results in 
immediate feedback from the virtual students. Videotaping of the pre-service teacher in the simulated 
environment also provides the opportunity for self, peer, and expert critique that can improve teaching practice. 
Finally, because the environment is simulated, each session in the simulator represents a fresh chance for 
pre-service teachers to re-try strategies and interventions for which they have received corrective feedback. In 
this sense, as the technology behind teaching simulators continue to improve their realism, teacher preparation 
programs should also maintain their efforts to provide additional, realistic practice environments for their 
pre-service teachers. 
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